Papers by Jasivan Alex Sivakumar
How to Leverage Digit Embeddings to Represent Numbers? (2025.coling-main)
Copied to clipboard
| Challenge: | Existing numerical reasoning models struggle to understand numbers, despite simple generalisations. |
| Approach: | They propose to use mathematical priors to compute digit embeddings and explicitly incorporate them into transformer models by adding a special token to the input embedded digits or introducing an additional loss function to enhance correct predictions. |
| Outcome: | The proposed method is compatible with any pretrained model and easy to implement. |